Wire protocol for a media server system

ABSTRACT

A wire protocol provides message formats for creating multiple network connections between a media server and a client. These multiple network connections may include a control link connection for passing control information and a data funnel connection for passing data of multiple media. The data funnel connection may be a multipoint-to-point connection that connects multiple data servers with the client. The protocol facilitates multiple requests being concurrently outstanding and asynchronous processing of requests. The protocol is designed to exist on top of a transport protocol layer.

TECHNICAL FIELD

The present invention relates generally to computer systems and moreparticularly to a wire protocol for communications between a mediaserver system and a client.

BACKGROUND OF THE INVENTION

The use of computer networks has been gaining popularity. Local areanetworks have become commonplace in business environments, andresidential users have begun to connect to computer networks, such asthe Internet. Multimedia applications that generate multiple mediaoutput, such as audio output and video output, have also been gainingpopularity. As such, it is not surprising that there has been anincrease in the number of multimedia applications available on computernetworks. In general, multimedia data has been transported acrosscomputer networks using transport protocols such as TCP/IP, but therehas been no protocol present on top of such transport protocols forfacilitating efficient and useful communications between clients andmultimedia servers.

SUMMARY OF THE INVENTION

The present invention overcomes the limitations of the prior art byadding an additional layer on top of a transfer protocol layer tofacilitate communications between a client on a first computer and amedia server on a second computer. In accordance with a first aspect ofthe present invention, a method is practiced in a computer network thathas a media server for storing data and a client. Per this method, awire protocol is provided that facilitates creation of connectionsbetween the media server and the client. The wire protocol is utilizedto create a control connection between the media server and the clientto facilitate exchange of control information. The wire protocol is alsoused to create a data connection between the media server and the clientthat facilitates the exchange of data between the media server and theclient at a rate substantially equal to a rate at which the data isconsumed by the client.

In accordance with another aspect of the present invention, a controlconnection is created to enable control information to pass between amedia server and a client computer in a distributed system that are onseparate computers. A data funnel connection is created to enable datato be transferred between the media server and the client at a ratesubstantially equal to the rate at which the client consumes data.

In accordance with an additional aspect of the present invention, afirst request for service is sent from a client to a media server. Thefirst request includes a first identifier that uniquely identifies thefirst request. A second request for service is also sent from the clientto the media server. The second request includes a second identifierthat uniquely identifies the second request and that differs from thefirst identifier. The media server asynchronously services the firstrequest and returns an acknowledgment to the client. The acknowledgmentincludes the first identifier. The media server asynchronously servicesthe second request and returns an acknowledgment that includes thesecond identifier.

In accordance with a further aspect of the present invention, a methodof decreasing network traffic is practiced in a computer network thathas a media server connected to a client via a network connection.Multiple messages are batched into a single message at the client. Asingle message is then sent from the client to the media server. Themedia server unbatches the multiple messages and processes each of themultiple messages.

In accordance with another aspect of the present invention, a method ispracticed in a distributed system that has a media server for storingfiles holding data of multiple media, and a client for requestingservice from the media server. A control connection connects the mediaserver and the client to pass control information, and a data connectionconnects the media server and the client to pass data. Per the method ofthis aspect of the present invention, a read request message is sentfrom the client to the media server over the control connection. Theread request message requests that data in a file of multiple media datastored at the media server be read and output to the client. A readrequest acknowledgment message is sent from the media server to theclient over the control connection to acknowledge the read requestmessage. The requested data is then forwarded from the media server tothe client over the data connection.

In accordance with yet another aspect of the present invention, a writerequest message is sent from a client to a media server over a controlconnection. The write request message requests that data from the clientbe written into a file at the media server. A write requestacknowledgment message is sent from the media server to the client overthe control connection to acknowledge the write request message. Thedata to be written is forwarded from the client to the media server overthe data connection, and the forwarded data is written into a file atthe media server.

In accordance with a further aspect of the present invention, a computersystem is part of a distributed system that has a media server forstoring files that hold data of multiple media. The computer systemincludes a control connection generator for generating a bidirectionalcontrol connection between the media server and the computer system. Thecontrol connection enables control information to be passed between themedia server and the computer system. The computer system also includesa data connection generator for creating a bidirectional data connectionbetween the media server and the computer system. The data connectionenables data to be passed between the media server and the computersystem.

BRIEF DESCRIPTION OF THE DRAWINGS

The present invention will be described in more detail below relative tothe following figures.

FIG. 1 is a block diagram of a distributed environment that is suitablefor practicing the preferred embodiment of the present invention.

FIG. 2 is a flowchart illustrating the steps that are performed to sendbatched messages in accordance with the preferred embodiment of thepresent invention.

FIG. 3 is a flowchart that illustrates the steps that are performed toestablish a control link between a client and a controller.

FIG. 4 is a flowchart that illustrates the steps that are performed toestablish a data funnel connection between a client and data servers ina media storage.

FIG. 5 is a flowchart illustrating the steps that are performed for aclient to read a file of data stored on a media server system in thepreferred embodiment of the present invention.

FIG. 6 is a flowchart illustrating the steps that are performed for aclient to write data into a file that is stored on the media storagesystem in the preferred embodiment of the present invention.

FIG. 7 is a flowchart illustrating the steps that are performed toobtain requested information for a client in accordance with thepreferred embodiment of the present invention.

FIG. 8 is a flowchart illustrating the step that is performed for aclient to unilaterally initiate an action via the wire protocol inaccordance with the preferred embodiment of the present invention.

DETAILED DESCRIPTION OF THE INVENTION

The preferred embodiment of the present invention provides a wireprotocol on top of a transport layer to facilitate communicationsbetween a media server system and a client. The wire protocol of thepreferred embodiment provides a number of messages that simplifycommunication between the client and the server and providefunctionality that is well-suited for interaction with the media serversystem. For example, the wire protocol enables multiple networkconnections to be established between a client and the media serversystem. In particular, a control link connection may be established tofacilitate the communication of control information between the mediaserver system and the client, and a data link connection may beestablished to facilitate the transfer of data between the client andthe server. The wire protocol facilitates multiple requests for servicefrom the server to be concurrently outstanding. These requests arehandled in an asynchronous fashion. A unique identification, denoted asan “incarnation,” is included with each request and response todisambiguate responses to requests. In other words, the incarnationenables a response to be matched with a request. The wire protocol alsoenables multiple messages to be batched together in a single messagethat may be transmitted over the network in a single packet rather thanin separate packets, thus reducing network traffic. The preferredembodiment is well adapted for use with data files that contain data ofdifferent media. Nevertheless, the present invention may also be usedwith single medium data files.

FIG. 1 is a block diagram depicting a networked environment 10 that issuitable for practicing the preferred embodiment of the presentinvention. The networked environment 10 includes a computer system 12that is connected to a controller 14 for a media server system. Thecomputer 14 may be one of numerous controllers in the system that areprovided to enhance fault tolerance and to help in load balancing. Thecontroller 14 controls access to media storage 16 which stores filesholding data of multiple media. The computer system 12 is connected tothe controller 14 via control link 18. The control link 18 is abidirectional logical connection that facilitates messages being passedbetween the controller 14 and the computer system 12. The computersystem 12 is also connected to the media storage 16 via a data funnel20. The data funnel 20 is a bidirectional logical connection thatconnects the respective media storage managers, denoted as cubs, 22A,22B and 22C, with the computer system 12. These logical connections areestablished on top of one or more physical connectors, such as an“ETHERNET” wire, a phone line or fiber optic line. The wire protocolfacilitates the creation of the control link 18 and the data funnel 20,as will be described in more detail below. The computer system 12 runscode 26 that constitute a viewer 26 for viewing output that is read frommedia storage 16. The viewer 26 acts as a client of the multimediasystem formed by the controller 14 and the media storage 16. Thoseskilled in the art will appreciate that the viewer 26 may be part of anapplication program, part of an operating system, or, alternatively,part of a dynamic link library (DLL) module. The viewer 26 includessupport for the wire protocol of the preferred embodiment.

As was mentioned above, the wire protocol of the preferred embodiment ofthe present invention facilitates multiple network connections to beestablished to service requests. The first connection is the controllink 18, and the second connection is the data funnel 20. The controllink 18 uses the TCP/IP protocol to send commands in the form ofmessages between the viewer 26 and the controller 14, and the datafunnel 20 relies upon the UDP protocol to transfer data between theviewer and the controller (although the TCP/IP protocol may be used aswell). Nevertheless, those skilled in the art will appreciate thatdifferent transport layer protocols may be utilized. The controller 14and viewer 26 use the UDP datagram protocol to package blocks of datathat are sent over the data funnel 20. Other datagram protocols may alsobe used by the present invention. It should be appreciated that the datafunnel 20 is a multipoint-to-point connection that connects each of thecubs 22A, 22B and 22C to the computer system 12. It should be alsoappreciated that the present invention may include multiple clients andmultiple media server systems. A single viewer and a single multimediaserver system are depicted in FIG. 1 for purposes of clarity andsimplicity.

In the preferred embodiment of the present invention, the cubs 22A, 22Band 22C hold multimedia data that may be played upon a request by asubscriber who uses the computer system 12. A more detailed descriptionof such a multimedia on demand system is described in U.S. Pat. No.5,473,362, which is explicitly incorporated by reference herein.

Multiple messages may be batched into a single message structure fortransmission over the control link 18. A batch of messages starts with aheader that contains the length of the batch of messages. The header isfollowed by a list of messages that are concatenated. Each of themessages begins with a header that describes the size of the message andthe type of message. Each message that is sent over the control link 18has the following format:

struct LinkMessage { int chunkLen; int MID; }

The chunkLen field specifies the length of the message in 8-byte units.The MID field is a message identifier. A message identifier is anumerical value that specifies a message type, where each message typehas a unique numerical value associated with it.

FIG. 2 is a flowchart illustrated in the steps are performed to batchmessages that are sent to the control link 18. First the messages arepacked into a single message (step 31 in FIG. 2). The single message isthen transmitted over the control link 18 (step 33 in FIG. 2). Therecipient of the message then unpacks the message (step 35 in FIG. 2).As noted above, the batch of messages starts with a header that containsthe length of the batch. This header is followed by a concatenated listof messages, each of which contains its own header. Each message headeridentifies the size of the message, and, thus, these headers may beutilized in conjunction with the batch header to unpack the respectivemessages until no messages remain to be unpacked.

FIG. 3 is a flowchart that illustrates the steps that are performed torealize control link 18 between the viewer 26 and the controller 14using the wire protocol of the preferred embodiment of the presentinvention. The viewer 26 initiates the creation of the control link 18by requesting a control link connection (step 28 in FIG. 3). Inparticular, the viewer 26 sends a message to the controller 14 that hasthe following format.

struct LinkViewerToMacConnectMessage : public LinkMessage { intMacToViewerProtocolRevision; int ViewerToMacProtocolRevision; intblackHole; char subscriberName[];//length as required };

The protocol revision fields of this message specify protocol revisionnumbers that identify which version of a protocol is being used. Thefields of the message also specify the subscriber name. The controller14 receives the request message from the viewer, establishes the controllink and returns a response to the viewer to inform the viewer of thesuccessful creation of the control link (step 30 in FIG. 3). The messagethat is returned to the viewer 26 has the following format.

struct LinkMacToViewerReportConnectedMessage : public LinkMessage { intMacToViewerProtocolRevision; int ViewerToMacProtocolRevision; TimeblockGroupPlayTime; unsigned blockGroupBlocks; unsigned nMaxOpenFiles;unsigned nBlockMaxBytes; unsigned maxBitRate; };

The blockGroupPlayTime field is of the Time data type and specifies theamount of time it takes a consumer (e.g., viewer 26) of the block ofdata to render the block of data. It should be noted that the Time datatype is a double precision floating point value. Each file of multiplemedia data is divisible into fixed size blocks. The blockGroupBlocksfield specifies the number of blocks in a group. The nMaxOpenFiles fieldspecifies the maximum number of files that may be concurrently opened bya single client on the multimedia server system formed by the controller14 in media storage 16. The nBlockMaxBytes field specifies the maximumblock size in bytes. Lastly, the maxBitRate field specifies the maximumbit rate of transmission of the blocks.

The data funnel 20 is created by passing messages in accordance with thewire protocol of the preferred embodiment of the present invention. FIG.4 is a flowchart illustrating the steps that are performed to create thefunnel connection 20. Initially, the viewer 26 sends a request messageto create a funnel to the controller 14 (step 32 in FIG. 4). The requestmessage has the following format.

struct LinkViewerToMacConnectFunnelMessage : public LinkMessage {unsigned maxBlockBytes; unsigned maxFunnelBytes; unsigned  funnelMode;char funnelName[];//length as required };

The maxBlockBytes field specifies the maximum number of bytes in a blockthat the viewer desires. The maxFunnelBytes field specifies the maximumnumber of bytes per network datagram that is sent across the funnelconnection. The funnelMode field identifies the current mode as “read,”“write” or “read/write.” Lastly, the funnelName field holds thecharacters and the name of the funnel specifies the type of transportbeing used.

The controller 14 receives the viewer request message and creates theappropriate data funnel connection (step 34 in FIG. 4). The controller14 sends a response message back to the viewer 26 to indicate that thefunnel has been successfully created. The response message has thefollowing format.

struct LinkMacToViewerReportConnectedFunnelMessage : publicLinkMessage { char funnelName[];//length as required };

As can be seen, the message specifies the name of the funnel. If forsome reason, the controller 14 is unable to create the data funnelconnection 20, the controller sends a ReportDisconnectedFunnelMessage(which is described in more detail below).

The wire protocol also enables the viewer 26 to request the playing of adata sequence by the multimedia server system on behalf of the viewer sothat the multimedia output is delivered from the media storage 16 to theviewer 26. FIG. 5 is a flowchart illustrating the steps that areperformed to initiate such playing of a multimedia sequence. Initially,the viewer 26 asks for the creation of a control link with thecontroller 14 by sending the LinkViewerToMacConnectMessage (describedabove) to the controller (step 36 in FIG. 5). The controller 14 thenestablishes the control link 18 (step 38 in FIG. 5). The controller 14then sends the LinkMacToViewerReportConnectedMessage (described above)to the viewer 26. If the control link 18 is already established, thesesteps are not necessary. The viewer 26 next asks the controller 14 toestablish a data funnel connection 20 by sending theLinkViewerToMacConnectFunnelMessage (described above) to the controller14. The data funnel connection is created and theLinkMacToViewerReportConnectedFunnelMessage (described above) is sentfrom the controller 14 to the viewer 26 (step 40 in FIG. 5). These stepsneed not be repeated if a data funnel connection already exists.

The viewer 26 subsequently selects a file (step 42 in FIG. 5). Theselected file must be opened. In order to open the file, the viewer 26sends a request to open the file to the controller 14. The requestmessage has the following format.

struct LinkViewerToMacOpenFileMessage : public LinkMessage { intplayIncarnation; char completeFileName []; };

The playIncarnation field specifies the incarnation for this request. Aswas discussed above, multiple requests may be concurrently outstandingand the requests are asynchronously handled. As a result, there must bea mechanism in place for matching responses with requests. Theincarnation serves as a basis for identifying each request so thatresponses may be matched with requests.

The controller 14 receives the request to open the file, opens the fileand sends a response message. The response message has the followingformat.

struct LinkMacToViewerReportOpenFileMessage : public LinkMessage {Win32Error dwError; int playIncarnation; unsigned openFileId; unsignedtigerFileId; unsigned block0DiskId; unsigned block0CubId; char *name;MmsFileEntry entry[1]; };

The dwError field specifies an error code which identifies which erroroccurred, if any, in opening the file. The playlncarnation field holds aplay incarnation value. The openFileld field specifies a handle for thefile that has been opened. The tigerFileId field specifies an IDassociated with the file that has been opened. Different clients mayreceive different openfileId's for a same file but each will receive thesame tigerFileId. The block0DiskId field identifies the Id of thestorage disk that holds the first block of the file that has beenopened. Similarly, the block0CubId holds the Id of the cub 22A, 22B and22C which holds the first block of the file that has been opened. Thename field holds the name of the file and the entry field holds a fileentry having information about the file.

The viewer 26 must then identify that the file is to serve as the“current file.” The “current file” is a variable value that ismaintained by the controller 14 to determine to which file subsequentplay/stop messages should refer. Thus, as part of the selection of afile, the viewer 26 sends a message that sets a value for the currentfile variable to be the file of interest. In particular, the viewer 26sends a message with the following format.

struct LinkViewerToMacSetCurrentFileMessage : public LinkMessage {unsigned openFileId; };

The openFileId field holds a handle that uniquely identifies the file ofinterest.

Once these steps have been completed, the viewer may ask for data fromthe file to be played (step 44 in FIG. 5). This viewer 26 sends amessage with the following format.

struct LinkViewerToMacStartPlayingMessage : public LinkMessage { Timeposition; int frameOffset; int playIncarnation; };

The position field specifies a position in the file where the viewer 26is to begin playing. The frameOffset field is reserved and theplayIncarnation field identifies the incarnation value for the playrequest.

The controller 14 returns a message to specify that playing has begun(see step 46 in FIG. 5). This message takes the following format.

struct LinkMacToViewerReportStartedPlayingMessage : public LinkMessage {Win32Error dwError; int playIncarnation; unsigned tigerFileId; unsignednumFileBlocks; unsigned fileBlockId; unsigned nextCubId; unsignednumCubs; char fileName[];//length as required };

The dwError field specifies which error, if any, has occurred ininitiating the playing of the file. The playIncarnation field specifiesthe play incarnation, and the tigerFileId field holds the tigerFileIdfor the controller 14. The numFileBlocks field specifies how many blocksare in the file. The fileBlockId field holds the Id for the block atwhich playing is initiated. The nextCubId field holds the Id of the cub22A, 22B or 22C which will start playing the first block of the file.The numCubs field specifies the number of cubs 22A, 22B and 22C in themedia storage 16. Lastly, the fileName field holds the name for the filethat is being played.

All of the above-described messages are passed over the control link 18.The read data from the media storage 16 is passed over the data funnel20 (see step 46 in FIG. 5). The media storage 16 begins forwardingblocks of the file of data to the viewer 26 over the data funnel 20(step 46 in FIG. 5). The blocks are delivered asynchronously from thecubs 22A, 22B and 22C of the media storage 16 over the data funnel 20 tothe viewer 26.

The messages are transferred as datagrams, where a datagram is a groupof one or more packets that logically represent a single message. Apacket is a single unit that is transmitted by the network hardware. Thesize of packets may vary. For example, in an “ETHERNET” network, packetsmay range in size from about 20 bytes to about 1500 bytes, whereas in anATM network, the packets may range from 48 bytes to about 64 kilobytes.When a datagram contains more than one packet it is said to be“fragmented” and the packets that make up the datagram constitute“fragments.”

In a heterogeneous network, it is possible that different pieces of thenetwork have different maximum packet sizes. The use of datagrams helpsto bridge between such networks. An application may control the datagramsize, which is logically independent of the packet size. In oneembodiment of the present invention, a 528 byte datagram size is chosenbecause it works well with a given file format on the Internet. Blocksof data are transmitted across the network in frames. For certaintransport protocols, a frame is a datagram. In other transportprotocols, a frame is an arbitrary size that correlates with themaxFunnelBytes value.

The blocks are transmitted in frames, and each frame includes acompressed funnel header having the following format.

struct CompressedFunnelFrameHeader { unsigned frameOffset; unsignedframeLength; int  playIncarnation; unsigned short playSequence; unsignedshort  fileBlockId; unsigned chunkLength; };

The frameOffset field specifies the offset at which the data beginsrelative to the beginning of the block. The frameLength field specifiesthe length of the frame. The playIncarnation field holds an incarnationfor a play request. The playSequence field holds a value that identifieswhere the block fits into the playing sequence. The fileBlockId fieldholds a numerical identifier for the block that is held in the payloadof the frame and the chunkLength field holds the total amount of data tobe sent for the block.

An example helps to illustrate how these fields are utilized. Supposethat a block of size 200 kilobytes is to be sent over the data funnel.The maximum datagram size is 128 kilobytes. The block of data is sent intwo datagrams. The first datagram has a frame offset of 0, a framelength of 128 kilobytes, and a chunk length of 200 kilobytes. The firstdatagram contains the first 128 kilobytes of data in the block. Thesecond frame has a frame offset of 128 kilobytes, a frame length of 72kilobytes, and a chunk length of 200 kilobytes. The second datagramcontains the remaining 72 bytes of the block.

The cubs 22A, 22B and 22C cause the blocks of the file to be deliveredat a particular frequency based upon a datagram size being used for thedata funnel 20 and the block play time. The blocks are delivered untilend of file is reached, assuming no errors or other intervening requests(step 46 of FIG. 5).

The system must then clean up by first closing the file and then closingthe funnel and control link connections, respectively (step 47). Thefile is closed by sending the following message from the viewer 26 tothe controller 14.

struct LinkViewerToMacCloseFileMessage : public LinkMessage { unsignedopenFileId; };

The message holds the file Id for the file to be closed.

The funnel 20 is closed by sending a disconnect message from the viewer26 to the controller 14. The disconnect message has the followingformat.

struct LinkViewerToMacDisconnectFunnelMessage : public LinkMessage { };

The controller 14 receives the disconnect message, disconnects thefunnel and returns the following message.

struct LinkMacToViewerReportDisconnectedFunnelMessage : publicLinkMessage { Win32Error dwError; };

The dwError field specifies whether an error occurred in disconnectingthe data funnel 20. If for some reason, such as a problem in theunderlying network, the data funnel 20 closes, the controller 14generates a disconnected funnel message without a recipient request toclose the data funnel from the viewer 26.

The control link 18 is disconnected using mechanisms provided by theTCP/IP protocol. Those skilled in the art will appreciate that thecontrol link 18 and funnel 20 need not be disconnected immediately afterthe file is no longer playing; rather, these connections may remainintact to be used further.

Typically, a file is played until end of file is reached. However, theviewer 26 may terminate the playing of a file by sending the followingmessage.

struct LinkViewerToMacStopPlayingMessage : public LinkMessage { };

When the controller 14 receives this message, the controller terminateshe playing of the file so that the blocks of the file are no longertransmitted over the funnel 20.

A file may also stop playing in situations where an error or other eventforces the termination of the playing of the file.

The preferred embodiment of the present invention is not limited toplaying the whole file but rather facilitates the playing of blocks of afile on a block-by-block basis. In particular, the viewer 26 may requestthat a particular block or portion of a block of a file be played. Theviewer 26 makes a request to play a block by sending the followingmessage to the controller 14 (step 51 in FIG. 6).

struct LinkViewerToMacReadBlockMessage : public LinkMessage { unsignedopenFileId; unsigned fileBlockId; unsigned offset; unsigned length;unsigned flags; Time tEarliest; Time tDeadline; int playIncarnation; intplaySequence; };

The openFileld field holds the Id for the file from which the block isto be read. The fileBlockId field holds the Id of the block that is tobe read. The offset field specifies the offset within the block of theportion requested to be played. The length field specifies the number ofbytes to send. If the viewer 26 requests that data beyond the end of theblock be sent (because offset length is greater than or equal to blocksize), the controller 14 reduces the length field so that only validdata will be sent. part of the flags field is used for system debugginginformation and the remainder is reserved for future use. The tEarliestfield specifies the earliest time at which the block may be scheduled tobe read, and the tDeadline field specifies the latest time at which theblock may be read. The playlncarnation field specifies the incarnationfor the request, and the playSequence field specifies where the readblock request fits into a sequence of block read requests.

In response to the viewer 26 request, the controller 14 sends anacknowledgment message to the viewer 26 and reads the requested block ofinformation. The acknowledgment message takes the following form.

struct LinkMacToViewerReportReadBlockMessage : public LinkMessage {Win32Error dwError; int playIncarnation; int playSequence; };

The dwError field specifies an error code which indicates which error,if any, occurred during the reading of the block of the file. Theplaylncarnation field holds the play incarnation value, and theplaySequence field holds the value that identifies where the block fitswithin a play sequence.

The viewer 26 may also explicitly request the cancellation of one ormore read block requests by sending the following message.

struct LinkViewerToMacCancelReadBlockMessage : public LinkMessage { intplayIncarnation; };

The cancellation request message specifies the play incarnationassociated with the request.

The preferred embodiment of the present invention also enables a viewer26 to write data to the media storage 16. FIG. 6 is a flowchartillustrating the steps that are performed in such a writing operation.Initially, the viewer 26 sends a request to the controller 14 to write ablock of data (step 51 in FIG. 6). It is assumed that the viewer 26 hasalready allocated a file on the storage media 16. In order to allocate afile, the viewer 26 sends the following message.

struct LinkViewerToMacAllocateFileMessage : public LinkMessage { intplayIncarnation; char newName; MmsFileEntry newMmsFileEntry[1]; };

The playIncarnation field specifies a play incarnation for allocatingthe file. The newName field identifies the file name for the new fileand the newMmsFileEntry field holds file information.

The controller 14 receives the request to allocate a file, attempts toallocate the file, and sends the following response message:

struct LinkMacToViewerReportAllocatedFileMessage : public LinkMessage {Win32Error dwError; int playIncarnation; unsigned openFileId; unsignedtigerFileId; unsigned block0DiskId; unsigned block0CubId; };

The dwError holds an error code that specifies whether an error occurredand identifies any error that did occur. The playlncarnation fieldspecifies a play incarnation value. The openFileld field holds a handlefor the file that has been allocated. The tigerFileId holds an id forthe file. The block0DiskId field holds the id of the disk that holds thefirst block of the file that has been allocated. Lastly, the block0CubIdfield holds the value of the id for the cub that holds block 0 of theallocated file.

Once the file is allocated and opened, the viewer 26 may request that ablock be written to the file by sending the following message.

struct LinkViewerToMacWriteBlockRequestMessage : public LinkMessage {unsigned openFileId; unsigned fileBlockId; unsigned numBlockBytes; int playIncarnation; };

The openFileId field specifies the file Id for the file to which theblock of data is to be written. The fileBlockId field holds an Id forthe file block that is to be written. The numBlockBytes field specifiesthe number of bytes in the block, and the playlncarnation field holdsthe incarnation value for the write operation. The controller 14 sends amessage to the cubs 22A, 22B and 22C to prepare for the data to bewritten. The controller 14 returns an acknowledgment to the viewer 26that contain the tag and an identifier for the cub that holds the fileto which the block of data is to be written (step 52 in FIG. 6). Theacknowledgment message has the following format.

struct LinkMacToViewerReportWriteBlockRequestedMessage : publicLinkMessage { Win32Error dwError; int playIncarnation; unsignedoperationTag; unsigned cubId; Time wbStamps [1+WBStampRequestedOnTiger];};

The dwError field holds an error code that either identifies an error orindicates that no error occurred during the request for the write block.The playlncarnation field holds a value for the play incarnation. TheoperationTag identifies the operation being performed because multipleoperations may be performed at the same time. The CubId field identifiesthe cub to which the block is to be sent, and the final field is a setof time stamps.

The viewer 26 then sends a funnel write data header over the funnel 20to the appropriate cub (step 54 in FIG. 6). The funnel write data headerhas the following format.

struct FunnelWriteDataHeader { unsigned operationTag; intplayIncarnation; unsigned numBlockBytes; };

The operationTag field specifies a tag that identifies the operation todifferentiate it from other operations. The playlncarnation field holdsthe current play incarnation value and the numBlockBytes field holds thenumber of blocks being sent in the write block. The viewer sends theblock of data over the funnel to the appropriate cub (step 56 in FIG.6). When the writing is completed, the controller 14 sends a message tothe viewer 26 indicating that the write of the block is completed (step58 in FIG. 6). This acknowledgment message has the following format.

struct LinkMacToViewerReportWriteBlockCompletedMessage : publicLinkMessage { Win32Error dwError; int playIncarnation; Time wbStamps[1+WBStampWrittenOnTiger]; };

The acknowledgment specifies an error code, a play incarnation and a setof time stamps.

The protocol also facilitates the viewer 26 sending a request to obtaininformation from the controller 14. FIG. 7 is a flowchart of the basicsteps that are performed. Initially, the viewer 26 sends an informationrequest message to the controller 14 over the control link 18 (step 62in FIG. 7). The controller 14 then returns information to the viewer inthe form of a response message (step 64 in FIG. 7).

In order to understand the utility of the steps shown in FIG. 7, it ishelpful to review some of the messages that may be sent to requestinformation and to provide requested information. For example, theviewer 26 may request information about a particular controller 14 bysending the following message.

struct LinkViewerToMacTigerInfoMessage : public LinkMessage { chartigerName[];//length as required };

The viewer 26 may also request information about the funnel 20 bysending the following message.

struct LinkViewerToMacFunnelInfoMessage : public LinkMessage { };

The controller 14 receives the request from the viewer 26 and returnsthe following message.

struct LinkMacToViewerReportFunnelInfoMessage : public LinkMessage {unsigned transportMask; unsigned nBlockFragments; unsignedfragmentBytes; unsigned nCubs; unsigned failedCubs; unsigned nDisks;unsigned decluster; unsigned cubddDatagramSize; };

The transportMask field is a bit mask that specifies which transportsare supported. The nBlockFragments field specifies the number offragments that may be in a block (in this context “fragments” refers toportions of the data block on secondary storage). The fragmentBytesfield specifies the number of bytes in each fragment. The nCubs fieldspecifies the number of cubs in the media storage 16 that are connectedvia the data funnel 20, and the failedCubs field is a bit mask thatspecifies whether any of the cubs have failed or not. The nDisks fieldspecifies the number of disks in the media storage 16. The declusterfield specifies how information is mirrored in the media storage 16.Lastly, the cubddDatagramSize field specifies the datagram size that isutilized by the cubs 22A, 22B and 22C.

The viewer 26 may request information about a particular file by sendingthe following message.

struct LinkViewerToMacFileInfoMessage : public LinkMessage { intplayIncarnation; char completeFileName[];//length as required };

The message specifies a playlncarnation and a FileName. The controller14 responds by returning the following report message.

struct LinkMacToViewerReportFileInfoMessage : public LinkMessage {Win32Error dwError; int playIncarnation; MmsFileEntry entry[1]; };

The report message includes an entry that holds information about thefile as well as a playlncarnation value and an error code.

In addition to obtaining information about a file, the viewer 26 mayalso obtain directory information from the controller 14 by sending arequest for directory information having the following format.

struct LinkViewerToMacDirectoryEntriesMessage : public LinkMessage {char *tigerName; int  incarnation; unsigned nPatterns; unsignedstartingFileId; char *patterns [nPatterns]; };

The message specifies the controller (i.e.,tiger) in which the directoryentries are maintained. An incarnation value for the request is includedin the message, and the number of patterns to be searched is specifiedin the nPatterns field. It should be appreciated that this request doesa textual search to look for certain textual patterns among thedirectory entries. The *patterns[nPatterns] field specifies the patternsthat are to be sought. The starting file ID specifies where in a list offiles the search is to begin.

The controller 14 receives the request for directory information andreturns a report. The report message has the following format.

struct LinkMacToViewerReportDirectoryEntriesMessage : publicLinkMessage { int incarnation; unsigned nFiles; unsigned nValid;unsigned nInitialized; unsigned nBlocks; unsigned nFree; unsignednEntries; int complete; TigerDirectoryEntry entries [nEntries]; };

The report message includes the incarnation value to delineate thisresponse from other responses and to match up the response with therequest. The nFile field specifies the number of files in the system.The nValid field specifies the number of files that are valid, and thenInitialized field specifies the number of files that have beeninitialized. The nBlocks field specifies the number of blocks on themedia server system. The nFree field specifies the number of free blocksand the nEntries field specifies the number of directory entries in thismessage that match the patterns that were requested. The complete fieldspecifies whether the end of the response to the request for directoryentries is contained in the message. Oftentimes the response is toolarge for one message and must be broken into multiple messages. Lastly,the entries[nEntries] field is an array for each matching directoryentry that describes the directory entry.

The viewer 26 may also request a number of administrative functions beperformed at the controller 14. For example, the viewer 26 may requestthat a file be removed from the storage on one of the cubs 22A, 22B and22C. The viewer initiates a request by sending a message with thefollowing format.

struct LinkViewerToMacRemoveFileMessage : public LinkMessage { intplayIncarnation; char fileName[];//length as required };

This format specifies a play incarnation and a file name. The controller14 receives the request and attempts to perform the request. Thecontroller 14 then returns a message with the following format.

struct LinkMacToViewerReportRemovedFileMessage : public LinkMessage {Win32Error dwError; int playIncarnation; };

The report message indicates whether the removal of the file wassuccessful and also returns to the play incarnation so as todisambiguate this report message from other report messages.

A viewer may request that a file be renamed. Specifically, the viewersends a message with the following format.

struct LinkViewerToMacRenameFileMessage : public LinkMessage { intplayIncarnation; char *newName; char oldName[];//length as required };

This message includes the old name of the file, the new name of the fileto which the file is to be renamed and a play incarnation value. Thecontroller 14, in response, attempts to rename to the file and sends areport message having the following format.

struct LinkMacToViewerReportRenamedFileMessage : public LinkMessage {Win32Error dwError; int playIncarnation; };

The report message specifies whether an error occurred and returns aplay incarnation value.

A viewer 26 may also request that a file be initialized so that the fileis at a state that is ready to be played. The viewer 26 sends such arequest by sending a message with the following format.

struct LinkViewerToMacInitializeFileMessage : public LinkMessage { intplayIncarnation; unsigned openFileId; };

The request message includes a play incarnation value and a file ID forthe file that is to be initialized. The controller 14 responds byattempting to initialize the file and returning a request message thatspecifies whether the initialization was successful or not. The responsemessage has the following format.

struct LinkMacToViewerReportInitializedFileMessage : publicLinkMessage { Win32Error dwError; int playIncarnation; };

As shown in FIG. 8 the viewer may also send messages over their controllink 18 that prompt no report message in return (step 66 in FIG. 8). Oneexample of such a message is a message the viewer 26 sends to thecontroller 14 to indicate that the viewer did not receive a block thatwas transmitted over the data funnel 20. This message is especiallyuseful because many protocols, such as UDP, cannot guarantee arrival ofa data block. The message the viewer 26 sends has the following format.

struct LinkViewerToMacReportLostBlockMessage : public LinkMessage { intscheduled; BufferDataHeader header[1]; };

The scheduled field specifies whether the block was scheduled as a blockread or scheduled as part of a file read. The header field identifiesthe block.

The viewer may also send a message indicating that the block that wastransmitted was damaged. The viewer 26 indicates such a damaged block bysending the following message to the controller 14.

struct LinkViewerToMacReportDamagedBlockMessage : public LinkMessage {BufferDataHeader header[1]; };

This message includes the data header for the block that was damaged.

While the present invention has been described with reference to apreferred embodiment thereof, those skilled in the art will appreciatethat various changes in form and detail may be made without departingfrom the intended scope of the present invention as defined in theappended claims.

What is claimed is:
 1. In a computer network having a client on a firstcomputer and a media server for storing data on a second computer, amethod comprising the steps of: providing a wire protocol thatfacilitates creation of connections between the media server and theclient; using the wire protocol to create a control connection betweenthe media server and the client to facilitate exchange of controlinformation between the media server and the client, the controlconnection utilizing a first transport protocol; and using the wireprotocol to create a data connection between the media server and theclient to facilitate the exchange of data between the media server andthe client at a rate based upon a rate at which the client consumes thedata, the data connection using a second transport protocol distinctfrom the first transport protocol.
 2. The method of claim 1 wherein thestep of providing the wire protocol includes providing formats formessages in the wire protocol.
 3. The method of claim 1, furthercomprising the step of using the control connection to exchange controlinformation between the media server and the client.
 4. The method ofclaim 1 wherein the media server includes multiple data servers andwherein the step of using the wire protocol to create the dataconnection includes creating a multipoint-to-point connection betweenthe data servers and the client.
 5. The method of claim 1, furthercomprising the step of using the data connection to transfer data ofmultiple media between the media server and the client.
 6. The method ofclaim 1, further comprising the step of using the wire protocol to causedata to be read from the media server and forwarded to the client overthe data connection.
 7. The method of claim 1 wherein the media serverincludes storage and wherein the method further comprises the step ofusing the wire protocol to cause data from the client to be passed overthe data connection to the media server to be written on the storage atthe media server.
 8. The method of claim 1 wherein the step of using thewire protocol to create a control connection includes creating abidirectional control connection that allows control information to flowfrom the client to the media server and from the media server to theclient.
 9. The method of claim 1, further comprising the steps of:sending a request message for service over the control connection fromthe client to the media server; and asynchronously processing therequest message at the media server.
 10. The method of claim 9, furthercomprising the step of asynchronously generating at the media server andsending over the control connection to the client a response messagethat responds to the request message.
 11. The method of claim 1 whereinthe first transport protocol provides delivery verification, and whereinthe second transport protocol does not provide delivery verification.12. The method of claim 1 wherein the first transport protocol is TCP,and wherein the second transport protocol is UDP.
 13. The method ofclaim 1 wherein the steps of creating a control connection and creatinga data connection create distinct logical connections carried on thesame physical connection.
 14. In a distributed system having a mediaserver on a first computer for supplying media output and a client on asecond computer for requesting the media output from the media server, amethod of interconnecting the media server and the client, comprisingthe steps of: creating a control connection for enabling controlinformation to pass between the media server and the client, the controlconnection utilizing a first transport protocol; and creating a datafunnel connection between the media server and the client fortransferring data between the media server and the client at a ratebased upon a rate at which the client consumes data, the data funnelconnection using a second transport protocol distinct from the firsttransport protocol.
 15. The method of claim 14 wherein the media serverincludes multiple data servers and wherein the data funnel connection isa multipoint-to-point connection that connects at least some of the dataservers with the client.
 16. The method of claim 14 wherein the mediaoutput includes multiple media.
 17. The method of claim 14 wherein thestep of creating the control connection includes passing a message fromthe client to the media server requesting the control connection. 18.The method of claim 14 wherein the step of creating the data funnelconnection includes passing a message from the client to the mediaserver requesting the data funnel connection.
 19. The method of claim 14wherein the control connection is bidirectional.
 20. The method of claim14 wherein the data funnel connection is bidirectional.
 21. The methodof claim 14, further comprising the steps of: sending multiple requestsfor service from the client over the control connection to the mediaserver such that the multiple requests are concurrently outstanding; andasynchronously servicing the multiple requests for service at the mediaserver.
 22. The method of claim 14 wherein the first transport protocolprovides delivery verification, and wherein the second transportprotocol does not provide delivery verification.
 23. The method of claim14 wherein the steps of creating a control connection and creating adata funnel connection create distinct logical connections carried onthe same physical connection.
 24. In a distributed environment thatincludes a media server for providing multiple media output to a clientwherein said client is connected to the media server via a networkconnection, a method comprising the steps of: sending a first requestfor service from the client to the media server wherein said firstrequest includes a first identifier that uniquely identifies the firstrequest; sending a second request for service from the client to themedia server wherein said second request includes a second identifierthat uniquely identifies the second request and wherein the secondidentifier differs from the first identifier; at the media server,asynchronously servicing the first request to provide multiple mediaoutput specified by the first request to the client and returning anacknowledgment to the client that includes the first identifier tospecify that servicing of the first request has begun; and at the mediaserver, asynchronously servicing the second request to provide multiplemedia output specified by the second request to the client concurrentlywith providing multiple media output specified by the first request andreturning an acknowledgment to the client that includes the secondidentifier to specify that processing of the second request has begun,such that, for a period of time, the media server is providing multiplemedia output as specified by both the first and second requests.
 25. Ina distributed system having a media server for storing files holdingdata of multiple media, a client for requesting service from the mediaserver, a control connection between the media server and the client forpassing control information and a data connection for passing databetween the media server and the client, a method comprising the stepsof: sending a read request message from the client to the media serverover the control connection using a transport protocol that providesdelivery verification, wherein said read request message contains arequest identifier uniquely identifying the request requests that datain a file of multiple media data stored at the media server be read andinput to the client; sending a read request acknowledgment messagecontaining the request identifier from the media server to the clientover the control connection to acknowledge receipt of the read requestmessage; and forwarding the requested data from the media server to theclient over the data connection at a rate based upon a rate at which theclient consumes the data using a transport protocol that does notprovide delivery verification.
 26. The method of claim 25 wherein therequested data is a single fixed size block of data.
 27. The method ofclaim 25 wherein the requested data is an entire file of data.
 28. Themethod of claim 25 wherein the transport protocol used to send the readrequest message over the control connection is TCP, and wherein thetransport protocol used to forward the requested data over the dataconnection is UDP.
 29. The method of claim 25 wherein the controlconnection over which the read request message is sent and the dataconnection over which the requested data is forwarded are distinctlogical connections that share the same physical connection.
 30. In adistributed system having a media server for storing files holding dataof multiple media, a client for requesting service from the mediaserver, a control connection between the media server and the client forpassing control information between the media server and the client anda data connection for passing data between the media server and theclient, a method comprising the steps of: sending a write requestmessage from the client to the media server over the control connectionusing a first transport protocol, said write request message requestingthat data from the client be written into a file at the media server;sending a write request acknowledgment message from the media server tothe client over the control connection to acknowledge the write requestmessage; forwarding the data to be written from the client to the mediaserver over the data connection using a second transport protocoldistinct from the first transport protocol; and writing the forwardeddata into the file at the media server.
 31. The method of claim 30wherein the first transport protocol provides delivery verification, andwherein the second transport protocol does not provide deliveryverification.
 32. The method of claim 30 wherein the control connectionover which the write request message is sent and the data connectionover which the data to be written is forwarded are distinct logicalconnections that share the same physical connection.
 33. In adistributed system having a media server storing files holding data ofmultiple media, a computer system comprising: a control connectiongenerator for creating a bidirectional control connection between themedia server and the computer system to enable control information to bepassed between the media server and the computer system, the controlconnection utilizing a first transport protocol; and a data connectiongenerator for creating a bidirectional data connection between the mediaserver and the computer system to enable data to be passed between themedia server and the computer system, the data connection using a secondtransport protocol distinct from the first transport protocol.
 34. Thecomputer system of claim 33, further comprising a request generator forgenerating requests for service from the media server that are passedover the control connection wherein each request includes a uniqueidentifier.
 35. The computer system of claim 34 wherein the requestgenerator further comprises a read request generator for generatingrequests to read data from the files of the media server so that theread data is output over the data connection to the computer system. 36.The computer system of claim 34 wherein the request generator furthercomprises a write generator for generating requests to write data fromthe computer system to the media server so that the data written isforwarded over the data connection to the media server and written intoa file at the media server.
 37. The computer system of claim 33, furthercomprising a message generator for generating a message that holdsmultiple messages for transmission over the control connection to themedia server.
 38. The computer system of claim 33 wherein the firsttransport protocol provides delivery verification, and wherein thesecond transport protocol does not provide delivery verification. 39.The method of claim 33 wherein the control connection generator and thedata connection generator generates distinct logical connections thatare carried on the same physical connection.